OPERATOR ENTROPY INEQUALITIES 

A. MORASSAEI 1 , F. MIRZAPOUR 1 AND M. S. MOSLEHIAN 2 

Abstract. In this paper we investigate a notion of relative operator entropy, 

which develops the theory started by J.I. Fujii and E. Kamei [Math. Japonica 

34 (1989), 341-348]. For two finite sequences A = {A ir -- ,A n ) and B = 

fvj ■ (i?i, • • ■ ,B n ) of positive operators acting on a Hilbcrt space, a real number q 



o 



and an operator monotone function / wc extend the concept of entropy by 

n 

Sf(A\B) := £ A] (A- l >B jA - l >) f (a^BjA^) A] 



~f*. i and then give upper and lower bounds for S^AIB) as an extension of an 

inequality due to T. Furuta [Linear Algebra Appl. 381 (2004), 219-235] un- 
der certain conditions. Afterwards, some inequalities concerning the classical 

"^h Shannon entropy are drawn from it. 

■*— > 

1. Introduction and preliminaries 

Throughout the paper, let B(J^) denote the algebra of all bounded linear 
£> ■ operators acting on a complex Hilbert space (Jif, (■,■)) and / is the identity 

i/-j ■ operator. In the case when dim Jif = n, we identify M(Jif) with the full matrix 

algebra Ai„(C) of all n x n matrices with entries in the complex field C and 

^-J ■ denote its identity by /„. A self-adjoint operator A £ M(J4?) is called positive 

if (Ax,x) > for all x £ Jif and then we write A > 0. An operator A is said 
to be strictly positive (denoted by A > 0) if it is positive and invertible. For 
self-adjoint operators A, B £ M(Jff), we say A < B it B — A > 0. Let / be a 

/\ '. continuous real valued function defined on an interval J. The function / is called 

operator decreasing if B < A implies f(A) < f(B) for all A, B £ M(Jif) with 
spectra in J. The function / is said to be operator concave on J if 

Xf(A) + (1 - X)f(B) < f(XA + (1 - X)B) 

for all self-adjoint operators A, B £ M(Jif) with spectra in J and all A £ [0, 1]. 

In 1850 Clausius [Ann. Physik (2) 79 (1850), 368-397, 500-524] introduced 
the notion of entropy in the thermodynamics. Since then several extensions 
and reformulations have been developed in various disciplines; cf. [ME, LR, 
L, NU]. There have been investigated the so-called entropy inequalities by some 
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mathematicians, see [BLP, BS, F2] and references therein. A relative operator 
entropy of strictly positive operators A, B was introduced in the noncommutative 
information theory by Fujii and Kamei [FK] by 

S{A\B) = A^ log(A-$BA-$)A*. 

When A is positive, one may set S(A\B) := lim^+o S(A+eI\B) if the limit which 
is taken in the strong operator topology exists. In the same paper, it is shown 
that S(A\B) < if A > B. There is an analogous notion called the perspective 
function in the literature, see [E, CK]: If / : [0, oo) — > K is an operator convex 
function, then the perspective function g associated to / is defined by 

g(B,A) = A$f(A-$BA-v)A$ 

for any self-adjoint operator B and any strictly positive operator A. One may 
consider a more general case. Let B = (Bi, • • • , B n ) and A = {A\, • • • , A n ) be 
n-tuples of self-adjoint and strictly positive operators, respectively Then the 
non- commutative /-divergence functional is defined by 

n 

Q(B,A) = J24f(A l B t AP)AJ. 

i=i 

i / i _i\ q i 
Next, recall that X\\ q Y is defined by X? IX ^YX 2) X 2 for any real number 

q and any strictly positive operators X and Y. For p e [0, 1], the operator X\\ P Y 

coincides with the well-known p-power mean of X, Y. 

Furuta [Fl] defined a parametric extension of the operator entropy by 

S P (A\B) = A^ (A'? BA-$Y log (a-*BA~*\ A^ , 

where p G [0,1] and A, B are strictly positive operators on a Hilbert space Jt? 
and proved some operator entropy inequalities as follows: if {Ai, ■ ■ ■ ,A n } and 
{Bi, ■ ■ ■ , B n } are two sequences of strictly positive operators on a Hilbert space 
Jrf? such that YTj=i Aj\]pBj < /., then 



log 



Yl ( A tip+i B i) + *o [I ~ Yl A &* B i 



,i=i 



(log to) [I 






J HP 



B j 






> -log 



v. 

E 



{Aj^p-iBj) +to\I 



(log k 







3 ^p^j 



xi: 
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for a fixed real number to > 0. 

The object of this paper is to state an operator entropy inequality parallel to 
the main result of [Fl] and refine some known operator entropy inequalities. 

2. Operator entropy inequality 
The following notion is basic in our work. 

Definition 2.1. Assume that A = (A±, ■ ■ ■ , A n ) and B = (B±, • • ■ , B n ) are finite 
sequences of strictly positive operators on a Hilbert space Jff. For g£ R and 
an operator monotone function / : (0, oo) — > [0, oo) the generalized operator 
Shannon entropy is defined by 



^(A|B):=^5/(A,|i?,), (2.r 



^ - - 1/2 

3 



where Sft4,l«i) = A f (a^ 'b^ 1 ")' f (a^ 'nrf") A 

We recall that for q = 0, f(t) = logt and A, B > 0, we get the relative 
operator entropy Sq(A\B) = A? log ( A~zBA~2 ) A^ = S(A\B). It is interesting 
to point out that S q (A\B) = —Si- q (B\A) for any real number q, in particular, 
Si(A\B) = -S(B\A). In fact, since Xf{X*X) = f(XX*)X holds for every 
X G M(Jif) and every continuous function / on the interval [0, ||^|| 2 ], considering 
X = B 1 / 2 A~ 1 / 2 and f(t) = log* we get 

S q (A\B) = A? (a-$BA-$Y log U-^BA-'A A^ 

= B^B'iA^ (a~*BA-*Y log (a~*BA-*\ A^B'^B^ 

= B^X*- 1 (A* A) 9 log (A* A) X- x B l 2 

= B^X~ l * (X^X~ l *y q log (A*A) X- l B^ 

= B^ {X-^X- 1 ) 1 " 1 {X- l *X- l Y l X- 1 * log (A*A) X- X B^ 

= B^ {X~ x *X~ x ) ^ q X log (X*X) X- l B^ 

= B^ {X- x *X- 1 ) X ' q \og{XX*)XX- 1 B } i 

= -Bh (X-^X- 1 ) 1_9 log (X- 1 * X- 1 ) B^ 

= _ B \ (x^X- 1 ) 1_ * log (X*- 1 A- 1 ) B~> 

= -S^ q (B\A). 

We need the following useful lemma. 
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Lemma 2.2. [Fl, Proposition 3.1] If f is a continuous real function on an in- 
terval J, then the following conditions are equivalent: 

(i) / is operator concave. 

(ii) f(C*XC + t (I-C*C)) > C*f{X)C + /(t ) (/ - C*C)) for any operator 
C with ||C|| < 1 and any self-adjoint operator X with sp(X) C J and for 
a fixed real number to E J. 

Ej=i CjCj)) for operators Cj with Ej=i CjCj < I and self-adjoint oper- 
ators Xj with sp(Xj) C J /or j = 1, ■ • • , n anc? /or a 3%ed rea/ number 
tn E J. 



For other equivalence conditions the reader may consult [FMPS, M] and refer- 
ences therein. Using an idea of [Fl] we prove the next result. 
The following result gives lower and upper bounds for S£(A|B). 

Theorem 2.3. Assume that f , A and~B are as in Definition 2.1. Let E?=i A? = 
E?=i Bj = I and f be operator concave. Then 



f 



3=1 \ 3=1 

> S{(A\B) 



f(t )[l-Y, A M 

3=1 



(2.2) 



for all p G [0,1] and for any fixed real number to > 0, and 



-f 



^(AAp-xBj) +t ll-J2 A 3 \ B 3 

3=1 \ 3=1 

< 5/(A|B) 



+f(to)(i-J2 A ^ B i 

3=1 



(2.3) 



for all p G [2, 3] and for any fixed real number to > 0. 



Proo/. Since £J =1 A^B, < (X)"=i A/) k (E"=i ^') (see [FMPS, Theorem 5.7], 
for every q E [0,1], and Ej=i A' = E/=i £3 = ^ we have E"=i Aj\\ p Bj < I. 



OPERATOR ENTROPY INEQUALITIES 

Let us fix a positive real number t . Since / is operator concave, we get 



/ 



j2(^p+iBj) + t Q [i - E a ^p b j 



i=i 



3=1 



=/ 



E {^7^7) A l) ( A 7 B i A 7) [ [ A 7 B ^ A 7Y A 1 



3=1 

1 / 1 



>E4K 5 W )*/ vw K 5 W M 



i i 



i=i 



+ /(*o) ( J ~ E ^p S 3 ) ( b ^ the Lemma 2 - 2 (iii)) 



i=i 



E4 (^Wf/fvv; 1 ) 4 + /(*>) / - x>A3. 

i=i V i=i 



E^(A-i^)+/(*o) /-E^-w 

i=i V j=i 



whence 



/ 



E( A i w^i) + to (i - E ^w- 



j=i 



i=i 



> E sKmbj) + /(to) / - E A ^ B 3 ) , 

i=i V 3=1 



Following a similar argument, we obtain 



/ 



^(^Vi^o+to'-E^v^ 



3=1 



3=1 



> J2 S^ 2 (Aj\Bj) + /(t ) / - E ^i 

3=1 V 3=1 



Thus 



7 



E(^v^) + ^ J - E a Ap b j 

3=1 V 3=1 

< - fi£_ 2 (A|B) . 



/(to)(/-E^^ 

3=1 
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Since / is a continuous nonnegative function, X q f(X) > for every X > and 
ijGM. Hence 

(^w)V(^w)>o. 

Consequently, SUAj\Bj) > 0. Thus 

S{(Aj\Bj) + S^iMBj) > (j = 1, ■ ■ • ,n) , 
whence — S'p_ 2 (A|B) < S^(A|B), which yields the required result. □ 

Remark 2.4. By taking f(t) = logt in Theorem 2.3, we get (1.1). 

Corollary 2.5. Let A = (Ai, ■ • • , A n ) and B = (B\, ■ ■ ■ , _B n ) 6e fayo sequences of 
strictly positive operators on a Hilbert space J$? such that ^™ =1 A? = S?=i ^j = 
/. If f '■ (0, oo) — >■ [0, oo) zs a function which is both operator monotone and 
operator concave, then 

(0/(E^i^7 1 B i )>5f(A|B) J 

(ii) /(/)>^(A|B). 

Proof, (i) Setting p = 1 in Theorem 2.3 and applying YTj=i AjQ&Bj = YTj=i B j = 
I, we obtain 

/ \Y, B i A ] lB A = f f E A ^ B A ^ ^ A ' B ) • 

(ii) Putting p = in Theorem 2.3 and using Y^=i A j\\oBj = Yjj=i A? = ^> we S e ^ 
fi 1 ) = f (X>) = f VEMiB/j > S'(A\B) . 

□ 

Next we extend the operator entropy for n strictly positive operators Ai, • ■ ■ , A n G 
and refine the operator entropy inequality. 



Corollary 2.6. Let A\, • ■ • , A n G M(Jif) be a sequence of strictly positive opera- 
tors on a Hilbert space Jf such that YTj=i A j = I ■ Then 



/ n \ 1 n 

log ^ AJ 1 > (log n)I - - J2 log A, 



(2.4) 
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Proof. Taking A = (A ir -- ,A n ) and B = (±/, ■ • • , ±1) and /(t) = log* in 
Corollary 2.5 (i), we get 

-2(logn)I + log(^AA=lo g (^f^AA 

> S? e (A\B) 

n 1 

= -V-((logn)/ + logAj) 

z — ' n 
3=1 

1 - 

= —(log 77.) I ^logA 



3 ' 

n <■ — ' 

3=1 



which yields (2.4). □ 

Corollary 2.7 (Operator Entropy Inequality). Assume that A±, ■ ■ ■ , A n € M(J4?) 
are positive invertible operators satisfying YTj=i Aj = I- Then 

n 

-^AjlogAj < (logn)J. 

Proo/. Letting A = (A u • • • , A n ), B = (±1, • • • , ±l) and /(£) = log t in Corollary 
2.5 (ii), we get 

= logJ 
> Sj*(A|B) 



n / 1 \ 

j=i v y 

n 

^4(-( io g^) j - io g^)4 



i=i 



■(log^^^-^AKlog^OAj. 

3=1 3=1 



□ 



Remark 2.8. Let a = (oi, ■ • • , a n ) and b = {pi, ■ ■ ■ , b n ) be n-tuples of positive 
real numbers such that Y^j=i a j = Y^j=i ty — 1- Put ^4i = [oj]ixi £ -Mi(C) and 
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Bi = [bi] lxl E Mi(C). It follows from Corollary 2.5 (ii) that > YJLi a j lo g - , 

•* 3 

which is an entropy inequality related to the Kullback-Leibler relative entropy or 
information divergence S(p, q) = YTi=i Pj 1°S ~ with the convention x log x = if 
x = 0, and xlogy = +oo if y = and x ^ 0; cf. [KL]. 

Theorem 2.9. Let p G [0, 1] and let A, B be two strictly positive operator on a 
Hilbert space J^ such that A\\ P _ 2 B < I and B 2 < A 2 . If f : (0, oo) — > [0, oo) is a 
function which is both operator monotone and operator concave, then 

f(A\ p+l B + t (I- A\ P B) ) - /(t ) (/ - A\ V B) 

> S f p (A\B) (2.5) 

> -f{A^B + t (/ - A\\ P B) ) + /(t ) (/ - A\ P B) , 
for a fixed real number t > 0. 

Proof. It follows from A\\ p _ 2 B < I that 

l / l i\P~ 2 l 

p-2 



/ i i \ P~ z 

(A-*BA-z) < A" 1 



A-iBA-i ) P < ( A-*BA~* ) A" 1 ( A'^BA 



A\ (a-?BA-*\ P A* < BA-' 2 B . 
Since B 2 < A 2 and the map t \- > — | is operator monotone, we have 



A^ [A-iBA-t )* A* < I 



so that A\\ p B < I. Now the same reasoning as in the proof of Theorem 2.3 (with 
n — 1 and by using Lemma 2.2 (ii)) yields the desired inequalities. □ 

Recall that a map $ : M(Jif) — > B(J^), where Jrf? and Jf are Hilbert spaces, 
is called positive if $(A) > whenever A > and is said to be normalized if it 
preserves the identity. The paper [MMM, Lemma 5.2] includes a refinement of 
the Jensen inequality for Hilbert space operators as follows: 

Let /i = (/ii, ■ ■ • , /i m ) and A = (Ai, ■ ■ • , A n ) be two probability vectors. By a 
(discrete) weight function (with respect to \i and A) we mean a mapping u) : 
{(hj) '■ 1 < 2 < m, 1 < j < n} — )• [0, oo) such that Y^i^ihJ)^ = 1 (j = 
1, • • • , n) and YTj=\ u {hj)^j — 1 (* — 1> ' ' ' 5 m )- If / is a real-valued operator 
concave function on an interval J, A±,--- ,A n are self-adjoint operators with 
spectra in J and $ : M(Jif) — > B(J^) is a normalized positive map, then 

(n \ m / n \ n 

Y,\i*{Ai) > X>/ X)w(i,j)Ai*(^) > J>$(/(A,)) . (2.6) 
i=i / i=i \j=i / i=i 



OPERATOR ENTROPY INEQUALITIES 9 

A matrix A = [a^] e .M n (C) is said to be a doubly stochastic matrix if a^ > 
(i, j = 1, ■ • • , n) and Ya=i a v = Sj=i a *i = 1- Now we introduce a refinement 
of the operator Jensen inequality. 

Theorem 2.10. Suppose that f is a real-valued operator concave function on an 
interval J and A\, • • • , A n are self-adjoint operators with spectra in an interval 
J . Assume that B = [bij] and C = [cij] are two n x n doubly stochastic matrices, 
Ui and o>2 are weight functions with respect to the same probability vector and 
$ : M(J^f) —7- B(J?r) is a normalized positive map. If the operator-valued functions 
F uu w 2 an d Fb,c « re defined by 

m / n \ 

F^ 2 (t) := £>/ E^ 1 -t)ui(i,j)+tu2(iJ)]XMAj) (0 < t < 1) 

and 

(0 < t < 1) , (2.7) 



n / n \ 



inen 

(i) 

(n \ n 

E^*(A) > f ^m > E A i*(/W) (o < * < i) . (2.^ 
3=1 / i=i 

in particular, 

/ n \ n 

/ - E $ (^) ^ F ^w ^ - E $ (/(^)) (o < * < i) ■ 

V i=i / i=i 

(ii) For any i (i = 1, • • • ,n), the maps 

t .— ► / ( £[(1 - t)wi(i,i) + tw2(i, J')]A^(A,) J (0 < t < 1), 

as we// as £ae function F U3liU2 are operator concave. 
In particular, Fb,c is concave on [0, 1]. 

Proof, (i) Since for every t in [0,1], the map 

(ij) 1 — >-0--t)ui(i,j)+tu 2 {hJ) (l<i<m, l<j<n) 

is a weight function, (2.8) follows from (2.6). By taking m = n,Xj = ^ ■ 
-,Ui(i,j) = nbij, 0)2(1, j) = ncij in F m>W2 (t), we obtain the second part. 
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(ii) Let 771,772 > with 771 + 772 = 1 and let ti,t 2 G [0,1]. For every i with 
1 < i < m, we have 



f[J2[( l ~ Tfrti - r] 2 t 2 )uJi(i,j) + (771*1 + r ] 2t 2 )u2(i,j)]X j ^(A j 
i=i 

n 

=f(m ^[(1 - ti)wi(«, j) + iiu; 2 (i, i)]A,$(^) 
3=1 

n 

+ 772 J^[(l - t 2 )ux(i,j) + ^(z, j)]Ai$(^ 
i=i 

n 

>^/i/(5Z[(l - *i)wi(«,j) +tiW 2 (z,i)]A i $(i4. i )J (by the concavity of /) 
i=i 

+ 7 te/(£[( 1 -*2)w 1 (i,j)+*2W 2 (* > i)]A i $(i4 i )' 



i=i 
which implies (ii). The concavity of Fb,c over [0) 1] i s clear. D 

By taking f(t) = —tlogt and <&(£) = t in (2.7) and by using Theorem 2.10, we 
obtain the following result: 

Corollary 2.11 (Refinement of operator entropy inequality). Assume that A\, • • • ,A n 
are positive self-adjoint invertible operators with spectra in an interval J and 
Y^j=\ A? = I ■ If B = [bij] and C = [cij] are two n x n doubly stochastic matrices, 
then 



(log7i)/>^ 



i=l 



J2[(l - t)btj + tc tj \A, log hT[(l - t)bn + taAAj 



>-^A,-logA,- (0<t<l), 
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